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Abstract —We present a new and efficient algorithm 
for determining a consensus value for a network of 
agents. Different from existing algorithms, our algorithm 
evaluates the consensus value for very large networks us¬ 
ing heat kernel pagerank. We consider two frameworks 
for the consensus problem, a weighted average consensus 
among all agents, and consensus in a leader-following 
formation. Using a heat kernel pagerank approximation, 
we give consensus algorithms that run in time sublinear 
in the size of the network, and provide quantitative 
analysis of the tradeoff between performance guarantees 
and error estimates. 

I. Introduction 

The problem of consensus among multi-agent sys¬ 
tems has wide applications in situations where mem¬ 
bers of a distributed network must agree. For ex¬ 
ample, the communication, feedback, and decision¬ 
making between distinct unmanned aerial vehicles 
(UAVs) [18], [10] is closely related to the consensus 
problem. In addition to UAVs, the distributed coor¬ 
dination of networks has important implications in 
cooperative control of distributed sensor networks [9], 
flocking and swarming behavior [27], and communi¬ 
cation congestion control [21]. Further, they form the 
foundation of the held of distributed computing [14]. 
The consensus problem is studied in [19], and several 
variations and extensions are examined by [20], [17], 
[15], [4]. 

We consider the classical model (see [19]) of agents 
with fixed, bidirectional communication channels and 
associated state. State changes occur continuously, 
influenced by communication with neighbors. A con¬ 
sensus algorithm is a continuous time protocol that 
specifies the information exchange between agents and 
provides a mechanism for systematically computing 
the consensus value, a unanimous state and an equi¬ 
librium of the system. In this paper, we focus on an 
efficient method for approximating the state values in a 
network in which agents reach consensus by following 
a linear protocol. We give algorithms for two different 
frameworks. The first computes a global consensus 
value involving all the agents in the network and runs 
in time sublinear in the size of the network. The 
second is a local algorithm to compute a consensus 
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value for a subset of agents under external influence, 
and runs in time sublinear in the size of the specified 
subset. In both, the consensus value returned is within 
an error bound of (9(e) for a given 0 < e < 1. 

Our algorithm involves solving a linear system by 
approximating the heat kernel pagerank of the network 
and relies on spectral analysis. The tools we present 
are relevant to numerous graph problems, including 
partitioning and clustering algorithms [3], [25], [16], 
flow and diffusion modeling [24], electrical network 
theory [5], and regression on graphs [2]. 

A. Previous Work 

a) The consensus problem: In [19], Olfati-Saber 
and Murray design a linear protocol for agents to reach 
a consensus value which is an average of initial states. 
They consider a network of agents as an undirected 
graph and use the Laplacian potential, defined in terms 
of the graph Laplacian (to be defined in Section [ri-B[ ), 
as a measure of disagreement among nodes. With this 
tool, they transform the the problem of reaching con¬ 
sensus to that of minimizing the Laplacian potential. 

An alternate formulation given in [10] abides by 
a linear protocol which favors the values of more 
highly connected nodes. In this way, agents which 
are more visible will have more of an impact on 
the group decision. Yet another variation is consensus 
in a leader-following formation, in which a set of 
agents called leaders abide by individual protocol but 
continue to influence to rest of the network. This 
problem has been studied in [23], [17]. 

b) Laplacian linear systems: Fast methods for 
solving systems of linear equations gained awareness 
with the nearly-linear time solver of [26]. Their al¬ 
gorithm implements a recursive procedure for sparsi- 
flying a graph related to the coefficient matrix so that 
solving the system is easy at the base of the recursion. 
This work was improved in [11], [12] with a higher 
quality sparsifler which reduced the depth of recursion. 
A parallel solver for SDD systems is given in [22] 
which runs in polylogarithmic time and nearly-linear 
work, an improvement to previous bounds. 

The methods in this paper are closely related to 
previous work on approximating the discrete Green’s 
function (or pseudo-inverse of the Laplacian ma¬ 
trix) [8]. They give an algorithm for solving Laplacian 
linear systems with a boundary condition on a subset 




of vertices that improves previous time bounds by 
using the method of heat kernel. 


B. Main Results 


In the model we consider, the communication pro¬ 
tocol followed by the agents in the network forms 
a linear system of equations, and the solution to the 
linear system is the state of the network as a function 
of time. Thus, computing the consensus value involves 
solving a linear system. 

We consider two forms of consensus. In the group 
consensus framework, we seek a consensus value that 
is a weighted average of intial states of the system, 
with weights proportional to node degrees. In this 
case, our algorithm computes the consensus value 
by approximating the state vector corresponding to 
the equilibrium of the system in sublinear time. In 
the local framework, a subset of agents imposes an 
external influence on an adjacent subset. The consen¬ 
sus achieved in this case is referred to as a leader¬ 
following consensus. Our algorithm for computing 
leader-following consensus on the subset of followers 
involves sampling vectors that approximate the equi¬ 
librium state vector, and runs in sublinear time. 

Specifically, our contributions are: 


1) We give a new algorithm for approximating 
the state of a system in a weighted average 
consensus framework to within a multiplica¬ 
tive factor (l-fe) and additive term 0{e) in 
time l^( g 3 fog|og(*e-i" ) where n is the size of the 
network. We call this algorithm AvgCONSEN- 
SUS and present it in Section [Ill-B| 

2) We give a new algorithm for approximating the 
state of a subset of agents in a leader-following 
consensus framework to within a multiplicative 
factor (1+g) and additive term (9(e) in time 
^/ (logi) (iog(£ )) \ vvhere s is the size of the 
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subset of followers. We call this algorithm LF- 
CONSENSUS and present it in Section [TVl 


Our sublinear time algorithms for computing con¬ 
sensus value rely on the efficiency of an algorithm 
for approximating heat kernel pagerank. Heat kernel 
pagerank is introduced in detail in [6] and [7] as a 
variant of Personalized PageRank [1]. The heat kernel 
pagerank approximator is introduced Section III-B and 
in more detail in [8]. 


II. Preliminaries 
A. Networked Multi-Agent Systems 

A dynamic multi-agent system is given by a tuple 
Gx = (G,x) where x is the state of the system and G 
is the communication network topology, represented 
by a graph. Namely, each agent is represented by a 
node and the communication network between agents 
is represented by the edge set E{G). Let Xj € M be 


a real scalar value assigned to v, such that x{t) = 
{x\{t),... ,Xn{t)Y denotes the state at time t. 

For an undirected graph G= {V,E) of size jV | = n, 
let the nodes of V be arbitrarily indexed by index set 
y = n} such that E C x y. For a node v,- € 

V, let Ni = {vj G V\{i,j) G £} be the set of neighbors 
of V, and let di = |A,j be the degree of v,. Two nodes 
Vi,Vj are said to agree if and only if Xi =Xj. The goal 
of consensus is to minimize the total disagreement 
among nodes. 

Definition II.l (Consensus). Let the value of nodes x 
be the solution to the equation 

X = f(x,u), x(0) gM". (1) 

Let X : K" —>■ K be an operator on x = (xi,... ,x„Y that 
generates a decision value x(x). Then we say all nodes 
of the graph have reached consensus with respect to % 
in finite time T > 0 if and only if all nodes agree and 
n{T) = XiYY) V i e We call x{x) := xix{0)) the 
consensus value. 


One notion of consensus is a weighted average 
consensus, given by 


Xwix) — 


'LjdiXj 

Lidi 


We show (Theorem III. 1[ ) that any connected undi¬ 
rected graph globally asymptotically reaches weighted 
average consensus when each node applies the dis¬ 
tributed linear protocol 

Ui{t) = \/di ^ {xj(t) -Xi{t)). (2) 

JeNi 

We assume G is connected for the remainder of the 
paper. 


B. Graph Laplacians and Heat Kernel 

In this work, we consider graphs which are weight- 
normalized so that every entry of the weighted adja¬ 
cency matrix A is atj G {0,1}, and the unordered pair 
{i,j) G E{G) if and only if aij — 1. Let D denote the 
diagonal degree matrix D{i,i) = di. 

The Laplacian is defined = 

Let A be the graph matrix A = I — A. We call A 
the Laplace operator. We note that A is similar to the 
matrix 

The heat kernel of a graph is a solution to the heat 
differential equation 

du 

— = —Am. 

dt 

The heat kernel can be formulated in the context 
of random walks on graphs. Consider the transition 
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probability matrix associated to a random walk given 
by P = D^^A. Then heat kernel is defined; 


^ k' 
k=0 

(3) 

oo A 



(4) 


k=Q 


A. Consensus and the Laplacian 

Consider the network of integrator agents with 
dynamics x,- = «,■ where each agent applies the dis¬ 
tributed linear protocol •El- We can characterize the 
dynamics of the system by the Laplace operator for 
the underlying graph, as described by the following 
theorem: 


The following similarity of the heat kernel, Mi, is 
of interest for its symmetry. Using definition Q, 

k=0 

k=0^'- 



Heat kernel pagerank is a row vector determined by 
two parameters; t G K+, and a preference row vector 
/ S K". It is given by the following equation: 

PGf=f^r = Ee-^^fF\ 
k=0 

Specifically, it is an exponential sum of random 
walks generated from a starting vector, f G U". As 
an added benefit, heat kernel pagerank simultaneously 
satisfies the heat equation with the rate of diffusion 
controlled by the parameter f. Both properties are 
powerful tools in consensus problems. 

III. Heat Kernel Pagerank eor 
Weighted-Average Consensus 

In this section we present a linear consensus proto¬ 
col for a dynamic network and show how to compute 
a weighted average consensus for the protocol using 
heat kernel pagerank. 

We first recall some principles of control theory. 
Consider the system with controls as in Q. A point 
Xe is an equilibrium point of the system if f(xe,u) = 0, 
and Xe is an equilibrium point if and only if x(f) = Xe 
is a trajectory. The system is globally asymptotically 
stable if, for every trajectory x(f), x(f) -GXe as f —>■ oo. 
To check this, two conditions are sufficient. 

Definition III.l (Global asymptotic stability). A sys¬ 
tem is globally asymptotically stable if 

1) it is stable in the Lyapunov sense, and 

2) the equilibrium Xe is convergent, i.e., for every 
e > 0, there is some time T such that 

||x(0) —Xe|| < 5 means ||x(f) —Xe|| < e 
for every time t > T. 

In particular, when considering a time-invariant 
linear state space model x = —Mx, for some matrix M, 
condition [T] is satisfied if M is positive semidefinite. 


Theorem III.l. Let Gx be a dynamic multi-agent 
system and suppose each node of G applies the 
distributed linear protocol Then the value of x 
at time t is given by the solution to the system 

x(t) = —Ax(f), x(0) £ K". (5) 

Additionally, this protocol globally asymptotically 
reaches a weighted average consensus. 


Proof Let Xe be an equilibrium of the system x = 
—Ax. Then by definition of equilibrium, Axe = 0 
and therefore Xg is a right eigenvector associated to 
the eigenvalue A = 0. In particular Xg is in the null 
space of A. Since G is connected, A has exactly one 
zero eigenvalue. Upon consideration, we see that the 
corresponding eigenvector is 1, the all-one’s vector, 
as the row sums of A are all exactly zero. Thus, 
Xg = al for some a £ K. Now, note that = 0 for 
the protocol and so the weighted average value 
Xw{x{t)), determined by u{t), is in fact invariant with 
respect to t. In other words, Xw(x(0)) = Xwixe), and 


Xw [Xe ) 


Y,idi{Xe)i 


Therefore this equilibrium is in fact the weighted 
average of the initial values of the nodes, and all nodes 
reach this value. Also, as the system is time-invariant, 
the system is stable since A is positive semidefinite. 

By Definition III.l the Theorem is proved. □ 


Now we can summarize the state of the system with 
a single heat kernel pagerank vector. 


Theorem III.2. Let Gx be a dynamic multi-agent 
system and suppose each node of G applies the 
distributed linear protocol (0- Let D be the diagonal 
degree matrix of G. Then the state of the system is 
given by 

x(t)=pTjD-\ / = x(0)"'D, (6) 

where M”' denotes the transpose. 

Proof. The solution to Q is the evolving state of the 
system. This solution is 

x{t)=e-'^x{Q)^Htx{Q). (7) 

Using the symmetrized version of heat kernel, 
x(f) = 

x(f)"' =x(0)"'Z)^/2('£,l/2^^£,-l/2p-l/2 (g) 

x(f)"' = (x(0)"-D)//,D-', 





where line uses the symmetry of D and Thus, 
the values x{t) given by (j^ are related to the heat 
kernel pagerank vector pt.f with preference vector / = 

xioyD. □ 


To compute the equilibrium state at which all agents 
reach consensus, we know that time T — 0{\/X\) is 
an upper bound. Figure depicts the results of com¬ 
puting weighted average consensus with heat kernel 
pagerank as in Theorem III.2 with different values 
for t. The network is an undirected social network of 
dolphins [13] with initial state values randomly chosen 
from the interval (0,1) (Figure lai. The chart plots 
total disagreement 11511 for disagreement vector d{t) — 
x{t)—X„{x)\, where x{t) — for f = x{0y''D. 

The vertical line corresponds to f = 1 /Ai. 


B. An Algorithm for Computing Consensus Value Us¬ 
ing Approximate Heat Kernel Pagerank 

Our weighted average consensus algorithm uses an 
algorithm for approximating heat kernel pagerank as 
a subroutine. We use the following definition of an 
approximate heat kernel pagerank. 


Definition III.2. Let / G K” be a vector over nodes 
of a graph G = (V,£) and let p, f be the heat kernel 
pagerank vector over G according to t and /. Then 
we say that v G K" is an e-approximate heat kernel 
pagerank vector if 

1) for every node v, G V in the support of v, 

(1 - e)p,,/[!] - e < v[!] < (1 +e)p,,/[/], and 

2) for every node with v[i] = 0, it must be that 
Pr./H < £■ 


Theorem III.3 (Weighted Average Consensus in Sub- 
linear Time). Let Gx be a dynamic n-agent system 
and suppose each node of G applies the distributed 
linear protocol Then the state of the system can 
be approximated to within a multiplicative factor of 
(1 -fe) and an additive term of 0{e) for any 0 < £ < 1 


in time O 


log(£ ‘)logn \ 
loglog(£“') P 


We call the algorithm AvgCONSENSUS. The algo¬ 
rithm makes a call to ApproxHKPR, an extension of 
the algorithm presented in [8] for quickly computing 
an approximation of a restricted heat kernel pagerank 
vector. For the sake of completeness, the algorithm 
and a summary of the results of [8] are given at the 
end of this section. 


'’y Theorem 


III.4 


below. The- 


£^logl ogt£ 

orem III.4 also verifies the approximation guaran¬ 
tee. □ 


Algorithm III.l: AvGCONSENSUS(G,.r,f,£) 

comment: input: 

comment: G as the (0, l)-adjacency matrix 
comment: x, initial state vector 

comment: t G 

comment: 0 < £ < 1, error parameter 
comment: output: x(f) 

D f- diagonal matrix of rowsums(G) 
f^x^D 

y ^ ApproxHKPR (G,t,f,£) 

return (yD ') 


C. A Sublinear Time Heat Kernel Pagerank Approxi¬ 
mation Algorithm 

The analysis for approximating heat kernel pager¬ 
ank follows easily from that for a restricted heat kernel 
pagerank vector by considering the entire vertex set 
rather than a subset. We refer the reader to [8] for a 
more complete description. 


Algorithm 1 ApproxHKPR (G,f,/,£) 

input: a graph G, f G K+, preference vector / G M", 

error parameter 0 < £ < 1. 

output: p, an £-approximation of p, f. 


initialize 0-vector p of dimension n, where n 
r^ ^logn 
log(e~') 


loglog(£- 


|V| 


f •<— //I I/I 1 1 l> normalize f to be a probability 
distribution vector 
for r iterations do 

choose a starting vertex u according to the 
distribution vector /' 

Start 

simulate a P random walk where k steps are 
taken with probability e ^*and k< K 

let V be the last vertex visited in the walk 

pM ^pM + 1 


End 
end for 


Proof of Theorem |///.i First, the £-approximate vec¬ 
tor X returned by ApproxHKPR is an approximation 
of the true state by Theorem III.2 Thus we have 
left to verify the approximation guarantee and the 
running time. The total running time is dominated 
by the heat kernel pagerank approximation, which 


p 4 - 1/r-p 
return ||/||i -p 


Theorem III.4. Let G be a graph, t G and f G K". 
Then, the algorithm ApproxHKPR (Gf,f,£) outputs 





















(b) Total disagreement over varying times t. Disagreement is 
computed in terms of the weighted average consensus Xwi^o)- 
The red line denotes the data point for t = \/X\. 

Fig. 1: Weighted average consensus convergence results. 


an e-approximate vector Ptj of the heat kernel pager- 
ank Ptj for 0 < £ < 1 with probability at least 1 — £. 
The running time of ApproxHKPR is O ( ) ■ 

IV. Heat Kernel Pagerank for Consensus in 
Leader-Following Formations 

In this section we consider a multi-agent network 
in which a certain subset of agents 1 C V are leaders, 
and the rest f = V\ l are dubbed followers. In this 
scenario, leaders will adjust their values according 
to individual protocol, while followers in the system 
adjust according to communication channels as usual. 
The consensus goal in this case is a leader-following 
consensus, in which all agents agree on a value by 
following the leaders. 

Let denote the protocol among the set of fol¬ 
lowers and let u^ denote the control dictated by the 
leaders and influencing the followers. Similarly, let 
denote the state of the followers and x^ denote the 
state of the leaders. The vectors x^ and x^ can be 
understood as the usual state vector x restricted to 
following and leading agents, respectively. Then we 
have the following definition. 

Definition IV.l (Leader-following consensus). A 
leader-following consensus of a system is achieved 
if for every agent v, there is a local protocol m,- such 
that Xi{T) = Xif{x{0)) for some finite time T >0 and 
some operator ;|f/y ; M" —> K. In this case, we call the 
value Xifi^i^)) the leader-following consensus value. 

For the protocol 

uft) = l/di ^ [ J‘^Xj{t)-Xi{t) ), (9) 

jeNi V V / 


the value for x is given by the dynamics 

u{t) =x{t) = —.^x{t). 

We let the followers abide by protocol Q. 

Let be the Laplacian .if restricted to rows and 
columns corresponding to the followers, and .ify^/ be 
.if with rows restricted to the followers and columns 
restricted to the leaders. Then the dynamics of the 
followers can be summarized by; 

X-f(f) = —JffX^f) — .^fiu\t). 

Since x^ is control of the subnetwork induced by the 
group of followers, this can be rewritten 

M-f = —^fX^ — or alternatively, 

x-f = —.if^'u-f -I-.if^'i^/iA 

Indeed, as long as the subgraph induced by the 
subset of followers is connected, the inverse * 
exists. We have arrived at the following. 

Theorem IV.l. Let Gx be a dynamic multi-agent 
system with proper subsets of leaders, I C V, and 
followers, f = V\l, such that the induced subgraph 
on f is connected. Suppose the followers apply the 
protocol 0. and suppose the leaders apply some 
individual protocol Uj = f{xi) dictated only by that 
leader’s state. Then the followers’ state values x-f at 
time t are given by the solution to the system 

JffX^f) =b{t), where b{t) =—{u-^ {t)+.^fiu^ {t)). 

An efficient algorithm called GreensSolver for 
solving linear systems .if/x^^ = b with a linear protocol 
applied to a subset specified by b is given in [8]. They 








show that the solution Xf can be computed with the 
symmetric heat kernel using the relationship 

= ( 10 ) 

where [Mi)f is with rows and columns restricted 
to the set /. 

The solution ^^^b can be approximated by sam¬ 
pling sufficiently many values of Further, 

it is given that the solution can be approximated in 
O ^ ^yiog io|(e- 1 )^ ) time, where s is the size of the 
subset of followers. 


with proper subsets of leaders, I C V, and followers, 
f = V \ l, such that the induced subgraph on f is 
connected. Suppose the followers apply the protocol 
0. and suppose the leaders apply some individual 
protocol Ui = f(xi) dictated only by that leader’s state. 
Then the state of the system can be approximated 
to within a multiplicative factor of (1 +e) and an 
additive term of 0{e) for any 0 < £ < 1 in time 
Q ^ jog(£- 1 ) ^ ’ where s is the size of the subset 

of followers. 

V. Discussion 


Algorithm IV.l: LFCONSENSUS(G,x,f,/,/,M',£) 
comment: input; 
comment: G as the (0,1) 
comment: x, initial state vector 
comment: t G M+ 
comment: /, subset of followers 
comment: /, subset of leaders 
comment: u^, protocol applied by the leaders 
comment: 0 < £ < 1, error parameter 
comment: output: xlt) 

procedure FOLLOWERPROT(G,x,f) 

for each i G I 

do i/[i] ^ uft) = l/di Y, (\f^Xj{t)-Xi 
jm ^ ^ 

return (u-b) 


procedure B(f) 

^ FOLLOWERPROT(G,.X,f) 
b < - +^flU^) 


b ^ B(f) 

^ ^ I/I 

T -y- i^log(l/£) 

N^T/e 

^ ^ logi+log(E~‘) 

initialize a 0 — vector x-' of dimension s 

for / = 0 to r 

{ draw j from [1,A] uniformly at random 
Xi -^r- ApproxHK(G,_/T /N,b,f,e) 

X-f ^X-f +Xi 

return 


The running time and approximation guarantees 
of LFCONSENSUS follow from the running time of 
GreensSolver [8], and we have the following: 

Theorem rV.2 (Leader-Following Consensus in Sub- 
linear Time). Let Gx be a dynamic multi-agent system 


The signihcance of sublinear running times is scala¬ 
bility. The robustness and efficiency of the algorithms 
AvgConsensus and LFConsensus are of great 
importance for networks too large to ht in memory, 
and the running time/approximation tradeoff allows 
for appropriate tuning. This is especially notable for 
local algorithms, which reduce computation over large 
networks to a small subset. For instance, while the 
group of leaders may be small in a leader-following 
framework, the difference in complexity for com¬ 
puting consensus in a leader-following formation as 
opposed to full group consensus can be signihcant. 
The subset of followers influenced by the leaders may 
be a small portion of the entire graph, so that s «n, 
and we are spared work over the entire graph in the 
case that we are interested in only a small area. In 
these cases, the gain in running times are valueable. 

References 

[1] S. Brin and L. Page. The anatomy of a large-scale hypertextual 
web search engine. Computer Networks and ISDN Systems, 
pages 107-117, 1998. 

[2] D. Cai, X. He, and J. Han. Spectral regression for efficient 
regularized subspace learning. In IEEE 11th International 
Conference on Computer Vision, pages 1-8. IEEE, 2007. 

[3] P. K. Chan, M. D. Schlag, and J. Y. Zien. Spectral k-way 
ratio-cut partitioning and clustering. IEEE Transactions on 
Computer-Aided Design of Integrated Circuits and Systems, 
13(9): 1088-1096, 1994. 

[4] L. Cheng, Z.-G. Hou, and M. Tan. Reaching a consensus 
in networks of high-order integral agents under switching 
directed topology. arXiv preprint arXiv:1304.3972, 2013. 

[5] P. Christiano, J. A. Kelner, A. Madry, D. A. Spielman, and 
S.-H. Teng. Electrical flows, laplacian systems, and faster 
approximation of maximum flow in undirected graphs. CoRR, 
abs/1010.2921, 2010. 

[6] F. Chung. The heat kernel as the pagerank of a graph. Proceed¬ 
ings of the National Academy of Sciences, 104(50): 19735- 
19740, 2007. 

[7] F. Chung. A local graph partitioning algorithm using heat 
kernel pagerank. Internet Mathematics, 6(3):315-330, 2009. 

[8] F. Chung and O. Simpson. Solving linear systems with 
boundary conditions using heat kernel pagerank. In Algorithms 
and Models for the Web Graph, pages 203 - 219, 2013. 

[9] J. Corts and F. Bullo. Coordination and geometric optimization 
via distributed dynamical systems. SIAM Journal on Control 
and Optimization, 44(5):1543-1574, 2005. 

[10] J. Fax and R. Murray. Information flow and cooperative con¬ 
trol of vehicle formations. IEEE Transactions on Automatic 
Control, 49(9): 1465-1476, 2004. 








[11] I. Koutis, G. L. Miller, and R. Peng. Approaching optimality 
for solving sdd linear systems. In IEEE 51st Annual Sym¬ 
posium on Foundations of Computer Science, pages 235-244. 
IEEE, 2010. 

[12] I. Koutis, G. L. Miller, and R. Peng. A nearly-mlogn 
time solver for sdd linear systems. In IEEE 52nd Annual 
Symposium on Foundations of Computer Science, pages 590- 
598. IEEE, 2011. 

[13] D. Lusseau, K. Schneider, O. Boisseau, P. Haase, E. Slooten, 
and S. Dawson. The bottlenose dolphin community of 
doubtful sound features a large proportion of long-lasting 
associations. Behavioral Ecology and Sociobioloy, 54:396- 
405, 2003. 

[14] N. A. Lynch. Distributed Algorithms. Morgan Kaufmann, 
1996. 

[15] K. L. Moore, T. Vincent, F. Lashhab, and C. Liu. Dynamic 
consensus networks with application to the analysis of build¬ 
ing thermal processes. In Proceedings of 18th IFAC World 
Congress, Milane, Italy, 2011. 

[16] A. Y. Ng, M. I. Jordan, Y. Weiss, et al. On spectral clustering: 
Analysis and an algorithm. Advances in neural information 
processing systems, 2:849-856, 2002. 

[17] W. Ni and D. Cheng. Leader-following consensus of multi¬ 
agent systems under fixed and switching topologies. Systems 
& Control Letters, 59(3^):209-217, 2010. 

[18] R. Olfati-Saber and R. Murray. Graph rigidity and distributed 
formation stabilization of multi-vehicle systems. In Proceed¬ 
ings of the 41st IEEE Conference on Decision and Control, 
volume 3, pages 2965-2971, 2002. 

[19] R. Olfati-Saber and R. Murray. Consensus protocols for 
networks of dynamic agents. In Proceedings of the American 
Control Conference, volume 2, pages 951-956, 2003. 

[20] R. Olfati-Saber and R. Murray. Consensus problems in 
networks of agents with switching topology and time-delays. 
IEEE Transactions on Automatic Control, 49(9): 1520-1533, 
2004. 


[21] F. Paganini, J. Doyle, and S. Low. Scalable laws for stable 
network congestion control. In Proceedings of the 40th IEEE 
Conference on Decision and Control, volume 1, pages 185- 
190, 2001. 

[22] R. Peng and D. A. Spielman. An efficient parallel solver for 
sdd linear systems. arXiv: 1311.3286, November 2013. 

[23] A. Rahmani, M. Ji, M. Mesbahi, and M. Egerstedt. Con¬ 
trollability of multi-agent systems from a graph-theoretic 
perspective. SIAM Journal on Control and Optimization, 
48(1): 162-186, 2009. 

[24] A. Raj, A. Kuceyeski, and M. Weiner. A network diffu¬ 
sion model of disease progression in dementia. Neuron, 
73(6):1204-1215, 2012. 

[25] J. Shi and J. Malik. Normalized cuts and image segmenta¬ 
tion. IEEE Transactions on Pattern Analysis and Machine 
Intelligence, 22(8):888-905, 2000. 

[26] D. A. Spielman and S.-H. Teng. Nearly-linear time algorithms 
for graph partitioning, graph sparsification, and solving linear 
systems. In Proceedings of the thirty-sixth annual ACM 
symposium on Theory of Computing, pages 81-90. ACM, 
2004. 

[27] J. Toner and Y. Tu. Flocks, herds, and schools: A quantitative 
theory of flocking. Phys. Rev. E, 58:4828^858, Oct 1998. 



